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Abstract 


We  prove  that  the  gap  in  optimal  value,  between  a mixed-integer 
program  in  rationals  and  its  corresponding  linear  programming 
relaxation,  is  bounded  as  the  right-hand-side  is  varied.  In  addition, 
a variant  of  value  iteration  is  shown  to  construct  subadditive  functions 
which  resolve  a pure-integer  program  when  no  dual  degeneracy  occurs. 
These  subadditive  functions  provide  solutions  to  subadditive  dual 
programs  for  integer  programs  which  are  given  here,  and  for  which  the 
values  of  primal  and  dual  problems  are  equal. 
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THE  VALUE  FUNCTION  OF  A 
MIXED  INTEGER  PROGRAM:  II 


by 

C.E.  Blair  and  R.G.  Jeroslow 


In  this  paper,  we  continue  our  study,  begun  in  [2  ],  of  the 
value  function  of  a mixed-integer  program.  This  function  G provides 
the  value  G(b)  of  the  program 

inf  cx  + dy 

(MIP)  subject  to  Ax  + By  = b 

x,  y > 0 
x integer 


in  variables  x = ( xl#...,xr),  y = (y^...^),  with  right-hand-side 
(r.h.s.)  b = (b, , . . . ,b  ) and  matrices  A,  B and  vectors  c,d  conformally 
dimensioned.  G(b)  is  defined  only  for  b feasible,  i.e.,  b for  which 
the  constraints  of  (MIP)  are  consistent. 

In  12],  we  emphasized  bounds  on  G(b)  [2,  Theorem  2.1],  a 
structure  theorem  for  G(b)  [2,  Theorem  3.3],  and  the  extendability 
of  G(b)  ]2,  Theorem  4.6].  Here  our  emphasis  is  on  the  difference 

l 


2. 


between  G(b)  and  the  value  function  L(b)  of  the  linear  programming 
relaxation  (LP)  of  (MIP)  (see  (LP)  below).  We  show  that  the  gap  In 
value  Is  finite  (Corollary  1.3)  and  that  in  certain  regions  S-  (defined 
below)  the  gap  function  is  subadditive  (Theorem  2.6).  Our  investigation 
of  the  gap  function  leads  quite  naturally  to  a subadditive  dual  program 
for  (MIP)  (Theorem  2.4),  which  places  the  subadditive  functions  into  a 
more  tractable  class  of  functions  than  does  an  earlier  subadditive  dual 
(see  [6]). 

We  also  show  that  the  subadditive  functions  needed  in  our  dual 
programs  can  all  be  obtained  by  value-iteration,  which  replaces  a 


subadditive  function  Fq  by  an  improved  function  that  provides  a 
better  value  in  the  dual  program,  with  finite  convergence  guaranteed 
under  many  commonly-occurring  hypotheses  (Theorem  2.8). 

Throughout  our  work,  we  have  a standing  assimption: 
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(SA)  A,  B,  b are  matrices  of  rationals; 

which  was  utilized  also  in  [ 2 3 - For  the  pure-integer  case  (s  = 0) , 
this  assumption  (SA)  takes  the  equivalent  form 
(SA)'  A,b  are  matrices  of  integers 

In  addition,  we  assume  throughout  that  G(0)  = 0 and  r > 1 if  s = 0. 


The  assumption  G(0)  =0  is  known  to  imply  that  (LP)  below  has  a 
finite  value  if  it  is  feasible  ( see  e.g.,  [6  ]).  The  assumptions 
made  here  will  be  utilized  below  without  explicit  citation. 

In  what  follows,  we  also  use  the  notation  A * [a^]  (cols)  and 
B «=  lb(k)l  (cols). 


3. 


Section  1:  Value  Gaps  and  Quadratic  Duals 

We  begin  by  stating  a result  (Theorem  1.2)  which  is  useful  in 


•***t  follows.  The  result  depends  on  (2,  Theorem  2.1  (2)J  and  requires 
the  following  lemma,  which  is  implicit  in  [7,  Lemma  1].  We  provide  a 
self-contained  proof  here,  since  it  is  very  short;  for  a generalization 
of  the  lemma  below  to  multicriteria  objective  functions,  see  [7], 

o 

1m—  1»1:  Suppose  that  z is  an  optimum  for  the  linear  program 

min  dz 

subject  to  Dz  = h 

* z > 0 (Z  = (Zj, ... »2p) ) 

and  z > 0 satisfies 

(2)  Zj  > 0 imples  z°  0 for  j = l,...,p 


(I)’ 


* * * 

Then  if  h = Dz  , z is  optimal  for  the  linear  program 

min  dz 

subject  to  Dz  - h' 

z > 0 

In  addition,  an  optimum  in  the  dual  to  (1)  is  also  optimum 
In  the  dual  to  (1)'. 

Proof:  The  program  (1)  has  the  dual 

^ max  Xh 

subject  to  XD  < d 


Let  X°  be  an  optimum  to  (3),  so  that  the  following  complementary 
slackness  condition  holds: 

(4)  z°(  d - X°D  ) * 0 

From  (2),  (4)  we  obtain  this  version  of  complementary  slackness: 

(4)’  z*(  d - X°D  ) - 0 . 

Mow  (4)'  is  widely  known  to  imply  that  z is  optimal  in  (1)'  . 

In  detail,  from  (4)'  dz  * X°Dz  = \°h’ , showing  that  z is  optimal 
in  (1)'  and  X°  is  optimal  in  the  dual  to  (1)'. 

Q.E.D. 

Theorem  1.2: 

There  is  a constant  4 > 0,  independent  of  b m (MIP) , which 
possesses  the  following  property: 

If  (x°,y°)  is  an  optimum  to  the  linear  programming  relaxation 

min  cx  + dy 

(LP)  subject  to  Ax  + By  = b 

x,  y > 0 


and  (MIP)  is  consistent,  there  is  an  optimum  (x1,  y1)  to  (MIP)  with 
(5)  I (x1,  y1)  - (x°,y°)  | < A 

It 

Proof:  Let  x be  the  vector  of  "integral  parts"  of 

x°,  i.e,  x*  x°  j for  j » l,...,r.  Put  b'  = Ax*+  By°  . By  Lemaa  1, 


* 

(*  » 


y°> 


is  optimal  in  the  program 

min  cx  + dy 


(6) 


subject  to  Ax  + By  * b' 
x,  y > 0 
x integer 


aince  it  is  optimal  when  the  requirement  "x  integer"  is  dropped  in 

(6) ,  and  yet  x does  satisfy  the  integrality  requirement.  From  [ 2 , 
Theorem  2.1  (1)]  there  is  a solution  (x*,y*)  to  (MIP)  with 

(7)  | (x1,  y1)  - (x*,y°)  | < C | b - b'  | + D 
with  C,D  > 0 independent  of  b,b'  . Using  (7),  we  have 


(8)  | (x1,  y1)  - (x°,y°)  | < | (x1^1)  - (x*,y0)  | + J (x*,  y°)  - (x°,  y°)  | 

< C | 2 (x°  - u x°  j)  a | + D + r 


I I*  * 


* _ ov  , o o. 


< c ( t | .<J)  I ) 

j-i  ' 


+ D + r 


By  taking  A to  be  the  r.h.s.  of  (8),  which  is  clearly  independent  of  b. 


the  Theorem  is  immediate. 


Q.E.D. 


In  what  follows,  L(b)  is  the  value  function  of  the  linear 
relaxation  of  (MIP),  i.e.,  L(b)  is  the  value  of  the  linear  program  (LP) 
as  a function  of  the  r.h.s.  b.  Clearly,  G(b)  > L(b)  when  b is  a 
feasible  r.h.s.  for  (MIP). 

Corollary  1.3: 


(9)  sup  { | G(b)  - L(b)  | | b feasible  in  (MIP)  } < + • 

Proof:  From  (5)  and  Theorem  1.2, 

I 

| G(b)  - L(b)  - J c (x1  - x°)  + c (y1  - y°)  | 

< J clJx1  - x°J  + | dj  ly1  - y°|  < (|c|  + |d|)  A<+°° 

Q.E.D. 


It  is  worth  noting  that  Corollary  1.3  implies 

| G(b)  - G(b')  | < | G (b)  - L(b)  | + J L(b)  - L(b')  J + | L(b')  - G(b' 

< K | b - b'  |+26, 

where  K is  any  constant  for  which 

| L(b)  - L(b' ) | < K J b - b'  ( , 

6 is  the  supremum  defined  in  (9),  and  b,b'  are  feasible.  This  improves  [2, 
Theorem  2.1  (2)],  in  that  the  modulus  associated  with  |b-b'|  can  be  taken 
to  be  that  of  (LP) , if  one  is  willing  to  use  2 6 as  a constant.  Note, 
however,  that  in  a pure-integer  program  (s  = 0)  it  may  still  be  necessary 
to  retain  a positive  constant,  if  the  modulus  used  is  K of  the  linear 
program  (LP).  constant  of  zero  can  be  employed  for  s = 0,  if  the 
modulus  is  K + 2 6,  since  |b-b’|  4 0 implies  j b— b ’ | > 1 for  integer 
vectors  b,b'. 

For  a function  f:  S -*  R,  S any  set,  we  define  the  epigraph 
epi(f)  by: 

(10)  epi(f)  = { (y,x)  | x«S  and  y > f(x)  ) 

For  a set  T E Rn,  conv  (T)  respectively  clconv  (T)  shall  denote  the 
convex  span  resp.  closed  convex  span  of  T.  Compare  with  [10],  [13]. 
Proposition  1.4: 

(11)  epl (L)  * conv(epi(G)) 

Proof:  Since  L(b)  < G(b)  for  b in  the  domain  of  G,  and  epi(L)  is 
convex  due  to  the  convexity  of  the  domain  of  L,  the  inclusion  ( a ) in 
(11)  is  clear. 
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To  establish  the  Inclusion  ( £ ) in  (11) , and  thereby  complete 
the  proof,  let  (z,b)  c epi(L),  so  that  z > G(b).  Let  (x°,y°)  be  an 

optimum  to  (LP),  so  that  G(b)  = cx°  + dy°.  When  b is  rational,  we  can  assume 

(x°,  y°)  is  rational  by  (SA) , so  that  (x°,y°)  = (x  /D,  y°)  with  x >0 

a vector  of  non-negative  integers,  and  D > 1 an  integer. 

SinceL(Db)  = DL(b),  as  one  easily  proves  using  Lenina  1.1, 

O * 

(x  , y D)  is  optimal  to  (LP)  with  r.h.s.  Db,  and  since  x is  integral^ 

* o 

we  see  that  (x  , y D)  is  also  optimal  to  (MIP)  with  r.h.s.  Db.  Then 
G(Db)  = x + y D = L(Db)  = DL(b)  < D z,  giving  (Dz,  Db)  e epi(G).  Since 
( 0,0  ) c epi (G) , 

( Dz,  Db) /D  + (0,0)  (D  - 1)/D  = (z,b)  c conv(epi(G)) . 

For  b irrational  and  (z,b)e  epi(L),  we  also  obtain  (z,b)e  epi(G) 
by  the  continuity  of  L and  the  fact  that  b can  be  approximated  by 
rational  r.h.s.  p-E  D 

We  next  present  a result  which,  in  Rockafellar's  duality 
framework  [11],  [12],  can  be  construed  as  a dual  program  for  the  pure 
integer  program  (IP) , which  is  (MIP)  for  s = 0: 

min  cx 

(IP)  subject  to  Ax  = b 

x > 0 and  Integer 

Let  denote  the  i-th  row  of  A and  let  b^  denote  the  i-th 

component  of  b.  The  quadratic  Lagrangean  for  (IP)  is  defined  to  be 
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(12)  L(x,X,p)  ■ (c  - XA)x  + p E (o^x  - b.)2  + X b 

i-1  1 

and  a dual  problem  for  (IF)  is 

(QD),  max  Inf  L(x,X,p) 

p > 0 x > 0 

x integer 

where  X=(X,,...,X  ) * Rm  is  a fixed  vector. 

i n 

Denote  the  value  of  (IP)  by  v(IP)  and  let  v(QD  ) denote  the 

K 

quantity  defined  in  (QD)^  . It  is  immediate  that  v(QDx)  < v(IP), 
since  for  any  p and  any  X 

(13)  inf  L(x,X,p)  < inf  {L(x,X,p)  j Ax  = b,  x > 0 and  integer) 
x > 0 

x integer 

* inf  {cx  | Ax  = b,  x > 0 and  integer)  = v(IP) 
Theorem  1.5:  Suppose  that  (IP)  is  consistent. 

(1)  For  any  X c Rm  there  is  p(X)  > 0 such  that  for  o > p(X)  we  have 

(14)  L(x*,X,p)  = min  L(x,X,p) 

x > 0 
x integer 

if  and  only  if  x is  optimal  in  (IP).  Furthermore,  p(X)  is 
independent  of  the  r.h.s.  b in  (IP).  In  particular,  v(IP)  = v(QD^) 

(2)  Let  X be  an  optimum  to  the  linear  dual 

max  Xb 

(15)  subject  to  XA  < c 


I 


of  the  linear  programming  relaxation  (LP)  of  (IP).  Then  if 

p > G(b)  - L(b),  (14)  for  X = X.  holds  precisely  if  x*  is  optimal  in 
(IP). 

Proof; 

(1)  From  [ 2,  Theorem  2.1(2)],  there  is  a constant  e > 0,  independent 
of  b,  for  which 

<16>  I G(b)  - G(b')  | < e | b - b*  | 

when  b'  is  a feasible  r.h.s.  in  (IP). 

Note  that,  if  b = (bx bm)  and  b'  = (b ',..., b^  are  integer 

vectors  then 


(H)  | b - b'  | < Z (b  - b/)2 

i=l  1 1 

where  |b  - b'|  denotes  the  norm  used  in  [2  ],  specifically  (see 
[ 2 . eqn  (1.1)]) 

d8)  | b - b'  | = “ | b - b!  I 

i=l  ll 

Put  p(X)  = 1 + e + | x | . Then  from  (16)  and  (17),  we 


ti 

have 

Y' 

P 

(19) 

h 

> G(b')  + X(b  - b')  + p | b - b*  | 

>G(b)  - c |b  - b'|  - |x|  |b  - b’J  + p Jb  - b'J 

> G(b) 

if  b'  * b,  where  b'  = Ax;  while  if  b'  - b,  we  have 

\ 
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(20)  L(x,  X,p)  - cx  > G(b) 

* 

Now  a non-negative  integer  vector  x is  optimal  in  (IP)  if  and 
* * 

only  if  b'  » b and  cx  * G(b).  Hence  by  (20)  if  x is  optimal, 

* 

L(x,X,p)  - G(b);  while  if  x is  not  optimal,  we  have  L(x,X,p)  > G(b) 
by  (19),  (20).  Therefore,  (14)  holds  if  and  only  if  x is  optimal 
in  (IP) , as  claimed. 

Regarding  the  "particular,"  from  (19)  and  (20)  we  have 
inf  {L(x,X,p)  J x > 0 and  integer)  = G(b)  = v(IP)  by  (19),  (20). 

Since  v(QD.  ) < v(IP),  this  shows  that  v(QD.)  = v(IP). 

A A 

(2)  Suppose  that  p > G(b)  - L(b).  Let  x > 0 be  an  integer  vector. 

If  b*  = Ax  is  different  from  b,  we  obtain 

(21)  L(x,  X.p)  - (c  - X A)x  + p E (bt  - b’)2  + X b 

> 0 + p + L(b) 

> G(b) 

(In  (21),  we  have  used  the  fact  that  c - XA  > 0 and  Xb  = L(b)).  If 
b'  = b,  we  obtain  (20). 

Using  (20), (21)  as  we  used  (19),  (20)  in  proving  the  first  part, 
we  establish  the  present  claim. 

Q.E.D. 

Rockafellar  obtained  a result  of  the  type  Theorem  1.5(1)  for 
convex  programs  (see  [ 12,Theorem  3.5)).  Our  result  is  of  course 
easier  to  prove  if  the  vector  x is  bivalent  or  bounded  in  (IP). 


F 


1J. 

Theorem  1.5(2)  is  also  more  elementary  than  Theorem  1.5(1),  since  It 
does  not  require  the  proximity  results  of  [ 2 ] , while  still  indicating 
a choice  X of  X for  which  p(X)  is  likely  to  be  smaller  than  for  general 
X. 

As  a consequence  of  Theorem  1.5,  the  value  of  the  "quadratic  dual" 

(QD)  max  max  inf  L(x,X,p) 

p > 0 x > 0 

x integer 

is  v(IP) . Here  the  analogy  to  ordinary  linear  programming  duality  is 
easier  to  see,  since  fixing  p * 0 one  easily  establishes  that  the 
program 

(22)  max  inf  L(x,X,0) 

XcR  x > 0 

x integer 

* max  inf  L(x,X,0) 

X«Rm  x > 0 

is  the  usual  linear  programming  dual  to  (LP)  for  s = 0.  However, 
since  X can  be  fixed  in  (QD)  while  still  having  v(IP)  = v(QDx),  the 

dual  (QD)  actually  has  many  features  of  a penalty  method. 


12. 

Section  2:  Subadditive  Dual  Programs 

Ue  recall  that  a function  F is  subadditive  on  a domain  S if 

(23)  F(v  + w)  < F(v)  + F(w) 


is  an  identity  for  v,wcS  (see  [4],  [5],  [8]).  Typically,  S is  required 
to  have  OeS  and  to  be  closed  under  addition.  In  what  follows,  we  take  S 
to  be  the  set  of  all  feasible  r.h.s.  for  (IP),  which  is  readily  verified 
to  possess  these  properties.  A particular  class  of  subadditive  functions 
are  those  which  are  non-negative  and  bounded: 


(24) 


Z 


^F  is  subadditive  on  S 


F(v)  >0  for  all  vcS 
and  sup  [F(v)|veS]  < + • 


We  shall  also  need  the  concept  of  the  upper  directional  derivative 
(at  zero)  of  a subadditive  function  F (see  [5],  [8]): 

(25)  F (v)  *=  lim  sup  ( F(Xv)/\  | ^\0+]  . 


We  recall  two  results  from  previous  work;  the  first  can  be 
proven  directly. 


Lemma  2.1:  (See  [5  ]).  If  F^  and  F^  are  subadditive  on  S,  so  is 

F^  + Fj*  In  particular,  for  any  subadditive  function  F and  any 
XcRD,  the  function  6 defined  by 

(26)  G(v)  = Xv  + F(v) 


is  subadditive  on  S 


_ --.IT-,  — 
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Lemma  2.2;  (See  [5]). 

If  G is  subadditive  on  S,  then 

(27>  £ G(a^*)x  + I G(b*k))y.  > G(b) 

J-l  1 k-1  k “ 

for  any  feasible  solution  (x,y)  to  (MIP). 

He  shall  also  need  one  more  lemma. 

Leana  2-3:  If  F Is  a non-negative,  subadditive  function  on  S,  and 

• > 0 is  any  scalar,  then  the  function  H defined  by 

(28)  H(v)  « min  { F(v),6  ) 

is  in  the  class  E of  (24). 


Proof;  Let  v,vcS.  If  F(v)  > 6 or  if  F(w)  > ft,  (28)  gives 

(29)  H(v  + w)  < 6 < H(v)  + H(w) 

as  F is  non-negative.  If  F(v)  and  F(w)  are  < 6,  then 


(30)  H(v  + w)  < F(v  + w)  < F (v)  + F(w)  = H(v)  + H(w). 

Since  the  two  cases  (29),  (30)  are  exhaustive  of  the  possibilities, 
H is  subadditive.  Clearly  H is  non-negative,  and  H is  bounded  by  i; 
hence  HcE. 

Q.E.D. 

Theorem  2.4:  Suppose  that  (MIP)  is  consistent. 

Let  X be  any  feasible  solution  for  the  dual 

max  Xb 

(DLP)  subject  to  XA  < c 

XB  < d 

to  (LP) . Then  the  subadditive  program 


f 


I/.. 


max  Xb  + F(b) 


<v 


Xa(j)  + F(a(J))  < Cj  , j = l,...,r 
Xb(k)  + F(b(k))  < d,  , k = 


F*E 

has  the  value  v(MIP)  of  MIP,  and  moreover  for  any  feasible  solution 
(x,y)  to  (MIP)  and  any  feasible  solution  F to  (D^),  we  have  (27)  for  G 
as  defined  in  (26) . 

Proof : The  bound  (27)  is  simply  a consequence  of  Leninas  2.1  and  2.2. 


This  bound  also  shows  that  F(b)  + Xb  < v(MIP)  for  F feasible  in  (D^), 

Jk 

It  suffices  to  prove  that  there  is  a solution  H to  (D^)  with 


as  G(a(j))  < Cj  and  G(b(k))  < \ for  all  j,k. 


Xb  + H(b)  > v (MIP) . to  this  end,  put 
(31)  F(v)  = inf  { (c-XA)  x + (d  - XB)y 


+ By  = v,x,y  > 0 ) 
d x integer  j 


Ax 

and  x integer 

F is  subadditive  since  it  is  a value  function  (see  [6  ])  and  F is 
non- negative  since  c - XA  > 0 and  d - XB  > 0. 

Let  (x°,y°)  be  a feasible  solution  to  (MIP)  with 
F(b)  = (c  - XA)  x°  + (d  - XB)y°  ( (x°,y  ) exists  by  [9]).  We  have 
v(MIP)  < cx°  + dy°  and  also 

(32)  cx°  + dy°  * (c-XA)x°  + (d-XB)y°  + XAx°  + XBy° 

= F(b)  + Xb. 

Set  H(v)  = min  { F(v),  F(b)}.  Then  v(MIP)  < H(b)  + Xb,  as  H(b)  = F(b) 

By  Lenina  1.8,  He£.  We  need  only  prove  that  H is  a feasible  solution  to 

(n  ),  and  we  are  done. 

A 
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t . 


However,  H(v)  < F(v)  for  all  v.  Hence  H(a(J))  < F<a<J>)  < c . XaU) 

for  all  J,  .nd  H(b«,  < ?(b«)  < d,  . Xb<«  £„r  all  k,  the  Uettr  „y  (25)_ 
Indeed,  H is  feasible  in  (Dx>  . 

Q.E.D. 

As  a consequence  of  Theorem  2.4,  if  we  define  a dual  program  (D)  to 
be  (y  with  X treated  as  a variable,  we  again  have  equality  of  values 
v(D)  - v(MIP).  indeed,  for  any  feasible  solution  X.F  to  D,  since  FeS 

it  is  easy  to  show  that  X is  a solution  to  (DLP) , and  Theorem  2.4 

applies.  The  proof  of  Theorem  2.4  shows  that,  by  chosing  X = X , with 

X an  optimum  in  (DLP),  we  can  take  F in  (D^)  to  have  an  upper  bound  equal 

to  the  "integrality  gap"  G(b)  - L(b).  This  is  the  smallest  bound 

possible  on  f for  any  of  the  dual  programs  (D  ). 

X 

Clearly,  information  on  the  gap  function  GP(b)  = G(b)  - L(b)  is  of 
value.  By  Corollary  1.3.  it  is  a bounded,  non-negative  function. 
gy»”Ple.:  Consider  the  pure-integer  program 


(33) 


minimize  - ( xx  + x?  + x3  ) 
subject  to 


» x2  » x3  > 0 and  integer 


for  the  three  settings  of  b given  by 


(34) 


M) 


J2) 


.(3) 


! 

& 


w 


For  b * \ an  optimum  to  (33)  is  (1,1,0),  and  this  solution  is 

also  the  optimum  to  (LP);  hence  GP(b^)  = G(b^^>  - L(b^)  = 0.  For 

b * b^,  an  optimum  to  (33)  and  to  (LP)  is  (0,1,1),  and  again  GP(b^)  = 0. 
However,  for  b = bv  an  optimum  to  (LP)  is  (0,4, 1/2),  and  an  optimum  to  (33) 
is  (1,2,1).  Therefore,  GP(b(3*>=-  4 + 41/2  = 1/2,  and  the 
subadditivity  relation 

(35)  GP(b(3))<  GP(b(1))  + GP(b(2))  = 0 

clearly  fails,  even  though  b^3^  = b^  + b^  . 

Despite  the  lack  of  global  subadditivity,  GP  is  subadditive  in 
certain  regions  that  we  now  define.  Put 

(36)  S^-  = (beS  j X is  optimal  in  the  dual  program  (DLP)  to  (LP)] 

For  any  specific  b°eS,  there  is  some  A.  optimal  in  (DLP).  By  Lemna  1.1, 

X is  still  optimal  in  (DLP)  for  all  beS  such  that  b is  a non-negative 
combination  of  the  columns  which  have  positive  variables  in  an  optimal 
solution  to  (LP)  with  r.h.s.  b°  . In  specific,  X is  still  optimal  in 
XDLP)  for  any  r.h.s.  b for  which  the  optimal  linear  programming  basis 
for  r.h.s.  b°  is  still  feasible,  and  hence  if  such  a beS  then  also  beS,-  . 


The  preceeding  remarks  are  intended  to  give  an  intuitive  idea  of 
the  nature  and  extent  of  S—  . Roughly  speaking,  S—  includes  all  those 

feasible  r.h.s.  b which  have  some  coranon  optimal  linear  programming  basis 
which  is  non-degenerate  for  some  r.h.s.  Clearly,  if  ^ 0 then  OeS- 

and  is  closed  tinder  addition,  just  as  is  true  of  S.  However,  S-  can 


i 
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be  more  extensive  than  the  region  In  which  one  linear  programming  basis 
Is  optimal.  For  instance,  if  there  are  dual  non-degenerate  linear 
programming  basic  optima  for  some  r.h.s.  b,  the  corresponding  X has  S- 

A. 

include  both  regions  In  which  either  basis  is  optimal. 

More  information  on  the  sets  S~  , as  well  as  the  important  global 
question  of  how  they  "fit  together,"  is  given  in  the  next  result.  In 
what  follows,  dim(T)  is  the  dimension  of  a set  T;  faces  of  polyhedra  are 

are  defined  in  [10],  [13]. 

Theorem  2.5:  Let  or,  P be  optima  in  the  dual  program  (DLP)  for 

(possibly  distinct)  r.h.s.  b. 

(1)  conv(S^)  is  a polyhedral  cone,  and  conv  (S^Pi  S = 

(2)  conv(S^)  0 conv(Sjj)  is  a face  ( possibly  empty)  of  both  conv(S^) 

and  conv(S.)  . 

P 

Proof:  By  the  Finite  Basis  Theorem  (see  [10],  [13]),  the  dual 

polyhedron  has  a representation  of  the  form 

(37)  { X|XA<c,XB<  d)  = conv{v^ v^}  + cone  {w^  , . . . ,w^  ] 

We  may  assume  0 > 0.  Hence  the  linear  form  Xb  is  bounded 
above  subject  to  \ A c,  X K • d 1 f and  only  I f 

(38)  w(J)b  < 0,  j «=  l,...,o 

(these  inequalities  being  vacuous  if  a =0).  When  (38)  holds,  the 
maximum  of  X b subject  to  these  constraints  is  max  {v^b  | i = 1,...,6}  . 


Therefore,  or  Is  an  optimum  in  the  dual  program  if  and  only  if  both  (38) 


holds  and  also 


ob  > pb 


ofb  > v'  'b  , i = 1,. . . ,0 


(The  inequality  ert>  >3b  is  actually  redundant  here). 


By  the  integrality  hypothesis  (SA) , all  the  vectors  v^,w^  in 


(37)  - (39)^  can  be  assumed  integral. 


We  now  claim  that  conv(Stf)  is  precisely  the  polyhedral  cone  of 


b described  by  (38) , (39)ff. 


Since  the  defining  Inequalities  (38),  (39)^  of  C. ^ are  in 


Integral  quantities,  = conv  { b«C^  | b integral  } . However  , If 


bcC^  and  b is  integral,  (LP)  has  a rational  optimum  with  rationals 


having  denominator  D > 1 for  an  Integral  D,  hence  DbeS  by  Leona  1.1. 


Since  C is  a cone,  we  obtain  C * conv{  beC  I bcS  } = conv(S  ),  as 
a a a 1 a ’ 


we  claimed. 


From  this  claim,  if  be  conv(S  ) D S,  then  bcC  and  beS,  so  indeed 

or  a 


b«Sa  . 


Next,  the  claim  shows  that  conv(Sa)  dconv(^)  is  defined  by  (38), 
(39)^  plus  the  equality 


ob  = pb 


Now  the  equality  (40)  occurs  as  an  inequality  of  (39)  , hence  requiring 


(40)  will  give  a face  (possibly  empty)  of  = conv(S^)  . 


I 


Q.E.D. 


ft' 

h 
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. 
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It  follows  from  Theorem  2.5  that  the  polyhedral  cone  C of  all  b 
satisfying  (38)  (i.e.,  those  b for  which  (LP)  is  consistent)  can  be 
represented  as  follows.  If  d * dim(C) , let  a(l) ,. . . ,o(p)  be  distinct 
points  among  { v(1),. . . ,v(&)}  of  (37)  for  which  dim(conv(S 


such  that  i * j implies  t sa(j)*  Then  we  have 


<*(  i) 


))  - d, 


(41) 


C - oo».(Sa(1)) 


and  if  i / j,  then  conv(Sa(1))  D conv(Sa(J))  is  a face  of  conv(Sa(i))  with 
dimension  not  exceeding  (d  - 1) . 


Theorem  2.6; 

If  X is  an  optimum  to  (DLP) , then  GP  is  subadditive  on  S^- 


In  fact,  for  beS—  we  have 


(42) 


{ 


GP(b)  = min  i (c  - XA)x  + (d  - XB)y 


|Ax+By=b,  x,  y> 


| and  x integer 


•) 


Proof : Exactly  as  in  (31),  (32),  we  see  that  if  the  minimum  on  the 

o 6V 


r.h.s.  of  (42)  is  attained  at  (x  ,y  ),  we  have 
(43) 


G(b)  = cx°  + dy°  = (c  - XA)x°  + (d  - XB)y°  + Xb 


For  beS^*,  we  have  L(b)  * Xb.  Using  this  and  (43) , we  obtain 


GP(b)  =*  (c  - XA)x°  + (d  - XB)y°,  which  is  (42),  and  we  recall  [ 6 ] 


that  value  functions  are  subadditive. 


Q.E.D. 


1 
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We  conclude  with  an  alternate  representation  of  the  gap  function 
GP  as  the  finite  limit  of  value  iteration  applied  to  any  "initial"  non- 
negative subadditive  function  Fq  ■ F which  does  not  exceed  GP,  and  show 
that,  at  each  step  of  value  iteration,  the  current  subadditive  function 
Fq  (see  below)  is  "improved"  (see  Theorem  2.8).  The  specific  value 
Iteration  here  is  the  one  corresponding  to  a shortest-path  problem  in  a 
certain  graph,  as  formulated  in  a dynamic  programming  context;  we  next 
describe  the  graph,  which  is  closely  related  to  Gomory's  "round-off- 
problem"  [4  ] and  involves  enumeration  on  the  non-basic  variables  of  an 
Jfc.p.  tableau. 

Let  the  linear  programming  relaxation  of  (IP)  be  solved  as  described 

e 

previously,  and  let  A * [ U;V  ] be  partitioned  into  basic  and  non-basic 
columns.  Note  that  (IP)  is  equivalent  to 


(IP)' 


min  c^b  +(cy-CyA)xv 
subject  to  Xy  + AXy  * b 

XU  * Xy  > 0 and  integer 


where  A - U_1V  and  b =U  V By  dual  optimality,  we  have  y = cv  * ^ > °* 
For  notational  purposes,  we  write  the  columns  of  A as  follows: 

(44)  A - [la> . !«>...>>] 

where  t « r - m > 0.  Clearly,  b > 0.  Note  that  L(b)  * CyB  1b  = Cyb. 

In  what  follows,  we  assume  b«S,  i.e.,  (IP)  is  consistent. 


/ 
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The  node  set  P of  the  graph  G = (P,E)  consists  of  all  vectors 

vcR  having  a representation 

t _ (J) 

(45)  v * u + E P.  a 

j=l  J j 

where  the  P^  are  integers  and  u is  a vector  of  integers.  As  regards 
the  edge  set  E of  G = (P,E),  a directed  arc  (v,w)  exists  for  v,weP 
if  and  only  if  either 

(^4*)  v “ a^  + w for  some  j = 1 t 

or 

(46b)  v = e^  + w for  seme  unit  vector  e^,  k « l,...,tn. 

In  (46a) , the  length  of  this  arc  is  -y^,  the  j-th  component  of  y . In 
(46b),  the  length  of  this  arc  is  zero.  (If  multiple  arcs  exist  from 
v to  w,  these  can  be  replaced  by  one  possessing  minimum  length).  Clearly, 
the  set  P is  a group  under  addition  and  beP. 

In  addition  to  nodes  and  edges,  there  is  a distinguished  subset 
T C P of  the  set  of  nodes  P,  consisting  of  those  ueP  which  are  vectors  of  j 

non-negative  integers.  Clearly,  T ^ 0,  beP,  and  there  is  a path  from  beP 

to  T,  since  if  (x^*,  Xy*)  is  a feasible  solution  to  (IP),  then 

- * * - * - - — 
b * Xy  + AXy  shows  b«P  and  x^  * b - AXy*  describes  a path  from  b to 

* —1 
Xy  c T.  More  generally,  there  is  a path  from  U vcP  to  T if  and  only 

if  (IP)  is  consistent  with  r.h.s.  v. 

Let  m(v)  be  the  length  of  a shortest  path  from  v to  T,  for  vcP, 

where  we  set  Ul(v)  = + • if  no  path  exists  from  vcP  to  T. 
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Let  X be  the  optimum  in  the  linear  dual  to  (IP)'  . The  next 
result  is  elementary,  and  we  omit  its  proof. 

Proposition  2.7:  If  veS^-  then  G(v)  * Xv  + LH(U  v)  and 

(47)  LH(U_1v)  = GP(v) 


The  following  is  a value-iteration  scheme  which  begins  at  an 

"initial  function"  F = F defined  on  P.  Given  F , we  obtain 

o n 


Fn+1  ^ 


M>  Vl(v> 


if  veT 


C Yj  + Fq(v  - a(j))  } , if  y^T 


In  what  follows,  for  two  functions  F and  G,  we  shall  write 
F < G to  abbreviate  F(v)  < G(v)  for  all  vcP. 


Recall  that  a function  F is  subadditive  on  P if 


F(v  + w)  < F(v)  + F (w) 


for  v,weP. 


See  also  [4],  [6],  [8]. 


Theorem  2.8: 


If  Fq  = F is  a subadditive  function,  and  0 < F < LH  then  every 

F defined  by  (48)  is  subadditive  and  F < LH.  Also, 
n n ~ 


F < F.  < F.  < ... 

O — 1 — L — 


If,  in  addition,  the  vector  y Is  strictly  positive,  then  for 
some  finite  N we  have 

(51)  Fn(v)  = LH(v) 
whenever  vc . 

Proof:  We  show  Fq  < LH  by  induction  on  n.  For  n = 0,  this  is  an 
hypothesis.  To  go  from  n to  (n+1) , if  veT  then  F (v)  = 0 = LH(v) , 

while  if  v^T  then  by  (48)  and  Fn  < LH 

(52)  Fn+l(v)  - mln  { V j + LH(  v - I(j))  } = LH(v) 

F is  non-negative  for  n = 0 by  hypothesis.  To  go  from  n to 
n 

(n+1),  if  veT  then  F ^v)  = 0 while  by  (48)  for  v{T  we  have  by 
induction 

(53)  FiH-1(v)  = Yk  + Fn(v  " ®<j))  > 0 + 0 = 0 

for  at  least  one  index  k = l,...,t  . Hence,  all  F^  are  non-negative. 

F^  is  subadditive  for  n = 0 by  hypothesis.  To  go  from  n to 
(n+1),  we  first  use  the  hypothesized  subadditivity  of  F to  prove 

(54)  Fn+l(v)  - Fn(v) 

If  veT,  then  0 = LH(v)  > F^(v)  > 0 and  Fn+j(v)  = 0 by  (48),  hence 
(54")  holds.  If  v^T,  then  since  v = a^  + (v  - a^)  for  j l,...,t, 
subadditivity  of  F^  gives 
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(55)  F (v)  < F (a(j))  + F (v  - a(j)) 

n — n n 

< Yj  + Fn(v  - a(^)  , j = l,...,t 

using  F (a^)  < LH(a^)  < y , j = 1 t.  Now 

® J 


(48)  and  (55)  give  (54). 

Using  (54),  and  supposing  F subadditive,  if  v + weT  then 

n 

Fq+^(v  + w)  = 0 < Fn+^(v)  + Fn+]/w)  since  F^^  is  non-negative. 
However,  if  v+w  iT,  then  by  (48)  we  have 


(56) 


n+1 


(v  + w)  < y.  + F (v  + w - a^) 


< Y.  + F(v-a)  + F (w) 
— k n n 


Fnfl(v)  + F»  ^ F^(v>  + Fn-H(w> 


n+1 


n+1' 


In  (56) > we  have  assumed  v$T  WLOG  ( for  v,weT  implies  v + weT) 

— (k) 

and  have  chosen  k so  that  Fn+^(v)  = y^  + ^n(v  “ a ) by  (48). 

Clearly,  (56)  shows  that  Fr+^  is  also  subadditive  and  completes  our 
inductive  proof  that  all  Fq  are  subadditive.  Then  (50)  follows 
since  (54)  is  implied  by  the  subadditivity  of  Fq. 

Let  us  now  assume,  in  addition,  that  y is  strictly  positive, 
and  let  e > 0 be  chosen  so  that  Y^  > e for  j = l,...,t.  We  now  prove 


by  induction  on  n that 


25. 


(57)  Fn+l*V*  - min  f ne»  LH(v)  ] . 

For  n = 0,  (69)  follows  since  Fq  = F > 0 . To  go  from  n to  (n+1) , If 
v«T  then  Fn+1(v)  = 0 LH(v)  = 0.  If  v^r,  then  by  (48) 

(58)  Fn+l(v)  = Yk  + Fn(v  - a(k)) 

for  some  k = l,...,t.  In  the  event  that  Fn(v  - a^)>  (n-l)t,  we 
have  from  (58)  and  Yk  > « that  Fn+1(v)  > min  { n«,  IH(v)  }.  On  the 

other  hand,  if  Fq(  v - a^)  > IH(v  - a^),  we  have  from  (53) 

£9)  F , . (v ) > min  {y  . + LH(v  - a^))  = LH(v) 

j=l,...t  j 

> min  {n«,  LH(v)]  . 

This  completes  our  proof  of  (57). 

Let  N be  chosen  to  that  Ne  > A,  where  4 is  the  £.h.s.  in  (9) 

of  Corollary  1.3.  By  Proposition  2. 7 , if  v is  a feasible  r.h.s.  tneu 

IH(v)  = GP(v)  < N«,  so  min  {Ne,  Ui(v)}  " LH(v).  As  Fn  < LH,  (57)  gives 
Fjj(v)  ■=  LH(v)  for  v feasible,  and  (51)  holds. 

Q.E.D. 


December  10,  1976 
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Integer  programning.  Cutting-planes,  Convex  analysis.  Duality,  Subadditivity 
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We  prove  rn at  tne  gap  in  optimal  value,  between  a mixed-integer  program  in 
rationals  and  its  corresponding  linear  programming  relaxation,  is  bounded  as 
the  right -hand -side  is  varied.  In  addition,  a variant  of  value  iteration  is 
shown  to  construct  subadditive  functions  which  resolve  a pure-integer  program 
when  no  dual  degeneracy  occurs.  These  subadditive  functions  provide  solution) 
to  subadditive  dual  programs  for  Integer  programs  which  are  given  here,  and  fi 
which  the  values  of  primal  and  dual  problems  are  equal. 
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